INSTINCT, INTELLIGENCE AND CHARACTER

questions. But it remains true that the old-fashioned
paper was often, or usually, written in a night or two in
the study, and was not tned on any pupils until the actual
examination of which it was part; whereas in the modern
achievement test the questions are accumulated for months,
and are particularly scrutinized to see that they both cover
adequately the whole ground to be tested, and are likely
to lead to answers which can be definitely and rapidly
marked as good, bad or indifferent, without any need of
judgment during the marking. During that time they are
given to thousands of children and a ruthless rejection is
enforced of questions which turn out to be ambiguous, or
too easy, or too hard, or which lead to answers difficult to
judge. Of the bad points and the possible abuses of
achievement tests we shall speak presently; but for this
principle of trying questions beforehand there can be nothing
but praise, the only conceivable objection being that in the
case of important examinations on which a great deal
depended, it might be difficult to make the trials with that
secrecy which human nature, even the human nature of
teachers, makes necessary. All who have set examination
papers will agree that in every case some question turns
out to be ambiguous to the children. Some question turns
out to be never or hardly ever answered. Some important
branches of the subject can be entirely avoided by whole
groups of candidates. In my own experience of setting
examination questions for children, I have always found it
a very great help, if time permitted, to send the paper to
some headmaster friend in another part of the country and
have his pupils try it.

During these standardizing trials, too, the marking of
the answers can be fixed and tabulated. Usually the
answers are required to be short* Sometimes the answer
has to be identified, and underlined, among several printed
after the question. Often the so-called " True-false " form
is used, in which the " questions " consist of a number of
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